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1. Introduction 

The problem posed in this note has its root in discussion carried out more than 10 years ago between 
the authors. Since then, we have discussed it with numerous people, and it has been posted as an 
open problem on the web site of one of us. We decided to post it on the ArXiv in order to have a 
permanent and stable version for it. 



2. The conjecture 

Let Y := (Yi , . . . , Yn) denote an ^-dimensional Gaussian vector with independent zero mean 
components of variance Oi = E(Y- 2 ). We assume for concreteness that <7j > a,i + \. 

Let T(9) denote an arbitrary orthogonal matrix on JR, (9 is a N(N — l)/2 dimensional parameter, 
and we take T(0) = /), and define the random variable X(#) = T(#)Y. For any M < N, define 

N—M 

£(N,M,9) = E( .min £ (X^O)) 2 ) . 

3=1 

£(N, M, 9) is the mean square error when reconstructing X(#) according to its M largest (in abso- 
lute value) components. When the matrix T(9) is a permutation matrix, this is the reconstruction 
error when keeping the M largest (in absolute value) components of Y, where Y is already ex- 
pressed in its Karhunen-Loeve basis, whereas other choices of 9 correspond to an expansion in 
other, non K-L bases. 

Let T(9) E V if T{9) is composed only of zeroes and ones, i.e. T(9) is a permutation and reflection 
matrix. We have the following 



Conjecture 1. 



mm £(N,M,Q) = min £(N, M, 9) = S(N, M, 0) . 
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Conjecture 1, if true, implies that the Karhunen-Loeve basis is the best basis not only for linear 
reconstruction but also for nonlinear reconstruction based on the M largest projections. 



3. The case of M = 1 

We do not know how to prove in general Conjecture 1. However, it does hold true for M = 1, i.e 
reconstruction based on the largest projection. Indeed, we have 

Lemma 1. Conjecture 1 holds true if M = 1. 

Proof: We can re-parametrize T such that rji = E(Xf) satisfies rji > f/i+i. Note that r/j = 
YsjLiT^o-j. Clearly, it is enough then to prove that E(maxl, 2 ) < E(m.ax.Y^). 

Let X denote a vector of independent Gaussian random variables with EXi = and E(Xi) 2 = rji. 
By Sidak's inequality [1], for any t > 0, 

P(n{\x z \ < t}) > Y[P(\Xi\ <t) = P(n{\Xi\ < t}) , 

implying that 

£(max \Xi\ 2 ) < £(max |^| 2 ) . (1) 

Next, we can check that 

m m 

5>i>X>, * = 1,...,JV-1. (2) 

i=l i=\ 

and clearly, because J2iTij = 1) a l so 

N N 

1=1 1=1 

Indeed, when m = 1, (2) holds because X) ■ ifj = 1- For m = 2, we have that 

+ % = J2( T ?J+ T 2j)°3 

j 

N 

= E( T y + T D°i + ( T n + T 2 2 i)^i 
i=2 

AT 

< ^2 E( T 5 + 4) + ( T n + T 2 2 i W 
i=2 
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= a 2 {2-Tl-Tl) + {Tl 1 +Tl)a l 

= oi + a 2 + (02 - 0i)(l - Tf-i - T 2 2 x ) < 01 + 02 • 

The general case of (2) follows by induction. 

By an inequality of Marshall and Proschan, see [4, Application 7. A. 18], one concludes that for any 
convex, permutation symmetric function <fi, 

E{4>{Xl...,X 2 N ))<E{<l>{Yl...,YZ)). 

Applying this to the function </>(•) = maxx 2 , one concludes that E(maxY^) > E(max.(Xi) 2 ), which 
together with (1) yields .^(maxYj 2 ) > .E(maxX 2 ), as claimed. □ 

Remark: the Schur convexity part of the argument holds also for the function 

M 

<Am(x) = max Y, x l- 
3=1 

What is missing in order to prove the conjecture for general M is the analog of (1): is it true that 

£(0m(X)) <%(X))? (3) 

Added September 15, 2011: R. van Handel communicated to us the following counter example 
to (3): take N = 3, M = 2 and Zi,Z 2 ,Z^ three independent standard Gaussians. Define X\ = 
{Z\ — Z 2 ) / \/2, X 2 = (Z2 — Zz)/y/2, and X^ = (Z3 — Z\)/y/2. The corresponding Xi are independent 
standard Gaussians. One checks numerically that 0.17 ~ Emm.(Xf) < Emm(Xf) ~ 0.19 (note 
that Conjecture 1 does hold in this case). Of course, it is possible that using (3) for only a subset 
of all Ts can help. 

This example also disproves the conjecture in [3, Problem 6, pg. 279] 

Remark Some inequalities related to the problem discussed in this note can be found in [2]. How- 
ever, the results contained there are not enough to resolve Conjecture 1, even within a multiplicative 
factor. 
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